INTEGRATED CIRCUIT AND ELECTRIC DEVICE USING THEREOF 

BACKGROUND OF THE INVENTION 
[0001] 1. Field of the Invention 

[0002] The present invention relates to an integrated circuit and an electric device using 
thereof. More particularly, it relates to improvement of techniques when the integrated 
circuit comprises a plurality of processors and the plurality of processors access a 
shared memory via a bus. 
[0003] 2. Description of the Related Art 

[0004] In recent years, multimedia data composed of video data, audio data and other 
kinds of data, is often processed in an electric device. In the electric device, a 
special-purpose processor or a general-purpose processor, mounted therein, processes 
the multimedia data. 

[0005] When the processor mounted therein has very high performance and power 
consumed by the processor need not be saved, all of necessary processes can be 
performed by the processor alone. 

[0006] However, a portable electric device, e.g., a cellular phone, a PDA, a digital video 
camera, a digital still camera, and so on, is powered by a battery in most cases. 
Therefore, in the portable electric device, it is desirable to reconcile reducing power 
consumption and improving performance so that the portable electric device becomes 
smaller, lighter and more efficient. There is the same problem as described above, in a 
non-portable electric device, e.g. a DVD player, a DVD recorder, HD recorder, and so 
on, for saving resources and/or energy. 

[0007] A document (tide: "System LSI techniques for MPEG-4 LSI", TOSHIBA 
REVIEW, Vol. 57, No. 1 (2002)) discloses the following points, to reconcile retaining 
sufficient performance and reducing power consumption in an integrated circuit, which 
processes the multimedia data. 
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[0008] (Point 1) Since it is difficult to acquire sufficient throughput only by a single 
processor, a processor that processes video signals and a processor that processes audio 
signals are provided, that is, a multi-processor configuration is adopted. 
[0009] (Point 2) Considering that I/O between chips of a processor consumes more than 
one half of the power, a memory, which is shared by both the processor that processes 
the video signals and the processor that processes the audio signals, is provided in an 
integrated circuit of the processor, and these processors access the shared memory via a 
bus. Thereby, reducing the power consumed by the I/O between the chips. 
[0010] Next, referring to Fig. 2, the conventional technique will now be explained more 
concretely. Fig. 2 is an outline block diagram of a conventional integrated circuit. 
[0011] As shown in Fig. 2, an integrated circuit 1 comprises a bus 2 in itself. A shared 
memory 3 is connected to the bus 2. 

[0012] A video processor 4 processing video signals, an audio processor 5 processing 
audio signals, and a multiplex/de-multiplex processor 6 multiplexing/de-multiplexing a 
bit stream, are provided, that is, a multi-processor configuration is adopted. These 
processors 4, 5 and 6 are connected to the bus 2. Herein, the video processor 4, the 
audio processor 5 and the multiplex/de-multiplex processor 6 have buffer memories 7, 8 
and 9 in themselves, respectively. 

[0013] These processors 4, 5, and 6 access the shared memory 3 via the bus 2 and 
perform processes in parallel, cooperating with each other. 

[0014] According to this configuration, since the shared memory 3 is accessed from all 
of the video processor 4, the audio processor 5, and the multiplex/de-multiplex 
processor 6, access to the bus 2 may be contended. Then, the bus 2 arbitrates the access. 
As a result, since at least one of the processors 4, 5 and 6 should await access, latency 
time must arise. 

[0015] Processes of the video processor 4 are heavier than those of the audio processor 
5 and the multiplex/de-multiplex processor 6. Unless the video processor 4 accesses the 
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shared memory 3 at high speed without latency time, the processes of the video 
processor 4 delay and the video processor 4 may not be able to complete processes to be 
done in a predetermined time. 

[0016] Since the conventional techniques fail to consider that load of one of the 
plurality of processors is different from those of the other, in some cases, the plurality of 
processors as a whole cannot complete processes to be done in real time. 
OBJECTS AND SUMMARY OF THE INVENTION 

[0017] An object of the present invention is to provide an integrated circuit reducing 
power consumption and performing processes in real time, and arts related thereto. 
[0018] A first aspect of the present invention provides an integrated circuit comprising: 
a bus; a first memory connected to the bus; a first processing unit operable to access the 
first memory via the bus; a second processing unit operable to access the first memory 
via the bus, and operable to perform at least one of data processing and calculation in a 
larger amount than the first processing unit; and a second memory operable to be 
accessed by the second processing unit without passing through the bus. 
[0019] With this structure, since the second processing unit, which performs at least one 
of data processing and calculation in a larger amount than the first processing unit, uses 
the second memory, the second processing unit is released from contention of access to 
the first memory. That is, the second processing unit can process without latency time 
caused by the contention, and probability that the integrated circuit can complete 
processes to be done in real time increases. 

[0020] Although access to the first memory and the second memory arises frequently, 
since the access is performed without I/O between chips, power can be saved. 
[0021] A second aspect of the present invention provides an integrated circuit as defined 
in the first aspect of the present invention, wherein the first processing unit expands 
compressed audio signals, wherein the second processing unit expands compressed 
video signals, and wherein the second processing unit stores reference image data into 
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the second memory, the reference image data being generated when the compressed 
video signals are expanded. 

[0022] With this structure, the integrated circuit can be used as a decoder that decodes 
compressed multimedia data. The decoder can expand compressed video signals 
without latency time caused by contention of access, although burden of expanding the 
compressed video signals is heavy. Probability that the integrated circuit can complete 
processes to be done in real time can be retained high. 

[0023] A third aspect of the present invention provides an integrated circuit as defined 
in the first aspect of the present invention, wherein the first processing unit compresses 
audio signals, wherein the second processing unit compresses video signals, and 
wherein the second processing unit stores reference image data into the second memory, 
the reference image data being generated when the compressed video signals are 
expanded. 

[0024] With this structure, the integrated circuit can be used as an encoder that 
compresses multimedia data. The encoder can compress the video signals without 
latency time caused by contention of access, although burden of compressing the video 
signals is heavy. Probability that the integrated circuit can complete processes to be 
done in real time can be retained high. 

[0025] A fourth aspect of the present invention provides an integrated circuit as defined 
in the first aspect of the present invention, wherein the first processing unit performs at 
least one of de-multiplexing audio signals and video signals from a bit stream and 
multiplexing audio signals and video signals into a bit stream. 

[0026] With this structure, since the first processing unit, whose burden is not as heavy 
as that of the second processing unit, also handles a bit stream, the integrated circuit can 
be constituted compactly. 

[0027] A fifth aspect of the present invention provides an integrated circuit as defined in 
the first aspect of the present invention, wherein the second processing unit generates 
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computer graphics image data. 

[0028] With this structure, since the second processing unit also handles a computer 
graphics image, the second processing unit can collectively and efficiently operate video 
signals and the computer graphics image, which have strong relationship mutually. 
[0029] A sixth aspect of the present invention provides an electric device comprising: an 
integrated circuit; and a converter, wherein the integrated circuit comprises: a bus; a 
first memory connected to the bus; a first processing unit operable to access the first 
memory via the bus; a second processing unit operable to access the first memory via 
the bus, and operable to perform at least one of data processing and calculation in a 
larger amount than the first processing unit; and a second memory operable to be 
accessed by the second processing unit without passing through the bus, wherein the 
first processing unit expands compressed audio signals, wherein the second processing 
unit expands compressed video signals to generate video signals, wherein the second 
processing unit stores reference image data into the second memory, the reference 
image data being generated when the compressed video signals are expanded, and 
wherein the converter is operable to convert the audio signals expanded by the first 
processing unit into analogue audio signals. 

[0030] With this structure, since the third decoder is mounted on the electric device, the 
electric device fulfils reproducing functions. 

[0031] A seventh aspect of the present invention provides an electric device as defined 
in the sixth aspect of the present invention, further comprising: a display device 
operable to input the video signals generated by the second processing unit to display an 
image; and a playback device operable to reproduce sounds according to the analogue 
audio signals converted by the converter. 

[0032] With this structure, in addition to effects of the sixth aspect, the electric devices 
can be used as a monitor reproducing both images and sounds. 

[0033] An eighth aspect of the present invention provides an electric device as defined 
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in the sixth aspect of the present invention, wherein the second processing unit 
generates computer graphics image data. 

[0034] With this structure, the second processing unit can collectively and efficiently 
operate video signals and computer graphics images, which have strong relationship 
mutually. 

[0035] A ninth aspect of the present invention provides an electric device comprising: a 
camera; a microphone; an integrated circuit; and a converter, wherein the integrated 
circuit comprises: a bus; a first memory connected to the bus; a first processing unit 
operable to access the first memory via the bus; a second processing unit operable to 
access the first memory via the bus, and operable to perform at least one of data 
processing and calculation in a larger amount than the first processing unit; and a 
second memory operable to be accessed by the second processing unit without passing 
through the bus, wherein the first processing unit compresses audio signals, wherein the 
second processing unit inputs video signals from the camera to compress the video 
signals, wherein the second processing unit stores reference image data into the second 
memory, the reference image data being generated when the compressed video signals 
are expanded, and wherein the converter is operable to input analogue audio signals 
from the microphone to convert the analogue audio signals into digital audio signals, 
and operable to output the digital audio signals to the first processing unit. 
[0036] With this structure, since the fourth encoder is mounted on the electric device, 
the electric device fulfils recording functions. 

[0037] The above, and other objects, features and advantages of the present invention 
will become apparent from the following description read in conjunction with the 
accompanying drawings, in which like reference numerals designate the same elements. 
BRIEF DESCRIPTION OF THE DRAWINGS 

[0038] Fig. 1 is a block diagram of an electric device in an embodiment of the present 
invention; and 
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[0039] Fig. 2 is an outline block diagram of a conventional integrated circuit. 
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0040] Next, referring to a drawing, an embodiment of the present invention will now 
be explained. Fig. 1 is a block diagram of an electric device in an embodiment of the 
present invention. 

[0041] This embodiment is explained using an example of a cellular phone as an electric 
device. However, an electric device to which the present invention can be applied may 
be one of the electric devices described in "Description of the Related Art". Furthermore, 
the electric device to which the present invention can be applied may be one of a TV 
apparatus, a TV conference system, a navigation system, and a surveillance camera 
apparatus, and so on, each of which at least one of the electric devices described in 
"Description of the Related Art" is build in. 

[0042] As shown in Fig. 1, the electric device comprises an integrated circuit 100. In 
this embodiment, the integrated circuit 100 is an encoder/decoder supporting MPEG 
(Moving Picture Coding Experts Group) 4. However, if necessary, the integrated circuit 
100 may be either an encoder or a decoder. 

[0043] For example, when the electric device is a DVD player, since the electric device 
need not have functions of an encoder, the integrated circuit 100 may be constituted as 
only a decoder. On the contrary, when the electric device is a surveillance camera 
apparatus, the integrated circuit 100 may be constituted as only an encoder. 
[0044] Video signal processes of the integrated circuit 100 may support at least one of 
ITU-T (International Telecommunication Union-Telecommunication sector) H.263, and 
JPEG (Joint Photographic Experts Group), and so on. 

[0045] Audio signal processes of the integrated circuit 100 may support at least one of 
AMR (Adaptive Multi Rate), ITU-T G279, ITU-T G273.1, voice CODEC, MP3 
(MPEG-1 Audio Layer3), and AAC-LC (Advanced Audio Coding-Low Complexity), 
and so on. 
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[0046] In Fig. 1, for simplicity of explanation, it is assumed that audio signals are 
composed of monaural components. However, the audio signals may be extended to, e.g. 
stereo (2ch), 5.1ch, 7.1ch, and so on. 

[0047] As shown in Fig. 1, the integrated circuit 100 comprises a main bus 101 in itself. 
In addition, a peripheral bus 103 is provided in the integrated circuit 100, and a bridge 
circuit 102 connects the main bus 101 and the peripheral bus 103. A shared memory 104, 
which corresponds to first memory, is connected to the main bus 101. 
[0048] In the integrated circuit 100, a video processor 105 processing video signals, an 
audio/multiplex/de-multiplex processor 106 processing audio signals and 
multiplexing/de-multiplexing a bit stream, and a system processor 107 controlling the 
whole system. That is, a multi-processor configuration is adopted. These processors 105, 
106, and 107 are connected to the main bus 101. The video processor 105 and the 
audio/multiplex/de-multiplex processor 106 have buffer memories 108 and 109 in 
themselves, respectively. 

[0049] Herein, the audio/multiplex/de-multiplex processor 106 corresponds to a first 
processing unit, the video processor 105 corresponds to a second processing unit, and 
the system processor 107 corresponds to a control unit. The video processor 105 
includes in itself an image input circuit 13 and an image display circuit 10, which will 
be explained in detail later. 

[0050] In this embodiment, the audio/multiplex/de-multiplex processor 106, whose 
burden is not as heavy as that of the video signal processor 105, collectively processes 
audio signals and multiplexes/de-multiplexes a bit stream. However, of course, a 
processor processing the audio signals and a processor multiplexing/de-multiplexing the 
bit stream may be provided independently. 

[0051] In this embodiment, the video processor 105 performs not only video signal 
processes but also generates/edits computer graphics images. The computer graphics 
images are blended with video signals or are dealt with independently. It is convenient 
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to handle usual video signals and the computer graphics images collectively, since the 
usual video signals and the computer graphics images have strong relationship mutually. 
However, processing computer graphics images may be omitted. 

[0052] In any case, a burden of the video processor 105 is heavier than that of the 
audio/multiplex/de-multiplex processor 106. That is, the video processor 105 should 
perform a larger amount of data processing and calculation than the 
audio/multiplex/de-multiplex processor 106. Therefore, a local memory 110 is provided 
in the integrated circuit 100, and the video processor 105 occupies the local memory 
110. 

[0053] The video processor 105 stores data in the local memory 110 and read data from 
the local memory 110. The data is composed of reference image data generated while 
the video signals are processed (expanded or compressed), data of the computer 
graphics images, and data of instructions accompanying thereto. The data may be 
transferred with or without using a DMAC (Direct Memory Access Controller). 
[0054] Since the video processor 105 accesses the local memory 110 without passing 
through the main bus 101, even when the main bus 101 is contended, latency time of the 
video processor 105 does not occur. Herein, the local memory 110 corresponds to a 
second memory. 

[0055] A first interface 111, a second interface 112, a third interface 113, and a fourth 
interface 114 are connected to the peripheral bus 103. A bit stream is outputted and 
inputted using the first interface 111. Status information, which may indicate codes of 
entered characters or entered numbers, is inputted from a key set 14 using the second 
interface 112. 

[0056] An AD (analog-to-digital) / DA (digital-to-analog) converter 15 is connected to 
the third interface 113, and the AD/DA converter 15 is connected to the 
audio/multiplex/de-multiplex processor 106 via the peripheral bus 103. 
[0057] When a microphone 16 outputs analogue audio signals to the AD/DA converter 
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15, the AD/DA converter 15 carries out analogue-to-digital conversion of the analogue 
audio signals to output digital audio signals thereof to the audio/multiplex/de-multiplex 
processor 106. When the audio/multiplex/de-multiplex processor 106 output digital 
audio signals to the AD/DA converter 15, the AD/DA converter 15 carries out 
digital-to-analogue conversion of the digital audio signals to output analogue audio 
signals thereof to a speaker 17 and the speaker 17 reproduces sounds thereto. Herein, 
the speaker 17 corresponds to a playback device. Otherwise, a headphone or the like 
may be used as a playback device. 

[0058] The video processor 105 expands video signals using the local memory 110. The 
image display circuit 10 of the video processor 105 generates video signals based on the 
expanded video signals to output the generated video signals to an LCD 11, which 
corresponds to a display device, and the LCD 11 displays an image according to the 
generated video signals. Otherwise, an organic electro-luminescence display, a Braun 
tube, and a plasma display, or the like may be used as the display device. 
[0059] The image display circuit 10 has functions converting image data of YUV format 
or image data of RGB format into video signals. The video processor 105 transmits 
image data stored in the local memory 110 to the image display circuit 10. The image 
data may be transferred with or without using the DMAC. 

[0060] When a camera 12 shoots and outputs image data to the image input circuit 13 of 
the video processor 105, the image input circuit 13 generates video signals, and the 
video processor 105 compresses the video signals using the local memory 110. 
[0061] The image input circuit 13 has a function converting video signals into image 
data of YUV format, which includes luminance signals and chroma signals, and a 
function converting video signals into image data of RGB format, which includes red 
signals, green signals, and blue signals. Converting video signals into image data as 
described above, the video processor 105 becomes able to process video signals. 
[0062] The video processor 105 transmits the image data converted by the image input 
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circuit 13 to the local memory 110. The image data may be transferred with or without 
using the DMAC. 

[0063] Next, operation when a bit stream is inputted will now be explained. First, when 
a bit stream is inputted from the first interface 111, the bit stream is inputted into the 
audio/multiplex/de-multiplex processor 106, and audio signals and video signals are 
de-multiplexed from the bit stream by the audio/multiplex/de-multiplex processor 106. 
[0064] The audio/multiplex/de-multiplex processor 106 transmits the de-multiplexed 
video signals to the video processor 105, and the audio/multiplex/de-multiplex 
processor 106 begins to expand the de-multiplexed audio signals in itself. 
[0065] When the video processor 105 receives the video signals, the video processor 
105 expands the video signals using the local memory 110. Herein, since the video 
processor 105 occupies the local memory 110 and access of the video processor 105 to 
the local memory 110 is not interrupted by contention in the main bus 101, the video 
processor 105 can expand the video signals without delay. 

[0066] The expanded video signals are transmitted to the LCD 11 via the image display 
circuit 10 of the video processor 105, and the LCD 11 displays an image according to 
the expanded video signals. Besides, the expanded audio signals are transmitted via the 
audio/multiplex/de-multiplex processor 106, the main bus 101, the bridge circuit 102, 
the peripheral bus 103, and the third interface 113, to the AD/DA converter 15. The 
AD/DA converter 15 converts the expanded audio signals into analogue audio signals, 
and the speaker 17 reproduces some sounds according to the analogue audio signals. 
[0067] Next, operation when a bit stream is outputted will now be explained. First, 
when the camera 12 begins operation, image data obtained by the camera 12 is inputted 
into the image input circuit 13 of the video processor 105, the image input circuit 13 
generates video signals, and the video processor 105 compresses the video signals using 
the local memory 110. Herein, since the video processor 105 occupies the local memory 
110 and access of the video processor 105 to the local memory 110 is not interrupted by 
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contention in the main bus 101, the video processor 105 can expand the video signals 
without delay. 

[0068] Besides, when the microphone 16 begins operation, analogue audio signals are 
converted into digital audio signals by the AD/DA converter 15, the digital audio signals 
are transmitted to the audio/multiplex/de-multiplex processor 106 via the third interface 
113, and the peripheral bus 103, the bridge circuit 102, and the main bus 101. Then, the 
audio/multiplex/de-multiplex processor 106 compresses the digital audio signals. 
[0069] When the video processor 105 has completed the compression of the video 
signals, the compressed video signals are transmitted to the 
audio/multiplex/de-multiplex processor 106, the audio/multiplex/de-multiplex processor 
106 multiplexes the compressed video signals and the audio signals compressed by 
itself, and the multiplexed bit stream is outputted to the outside, e.g. recording medium, 
of the integrated circuit 100 via the main bus 101, the bridge circuit 102, the peripheral 
bus 103, and the first interface 111. 

[0070] While the audio/multiplex/de-multiplex processor 106 is performing some 
processes using the shared memory 104, the video processor 105 can perform the 
following processes using the local memory 110 without access contention. 
[0071] (1) Compressing image data, stored in the local memory 110 via the image input 
circuit 13; 

[0072] (2) Expanding compressed data to image data; 

[0073] (3) Generating image data using computer graphics operation; and 

[0074] (4) Processing/editing image data. 

[0075] Thereby, reducing memory access contention, probability that the integrated 
circuit 100 can complete processes to be done in real time increases. 
[0076] According to the present invention, since a processing unit, whose burden is 
heavy, occupies the second memory, avoiding latency time caused by contention of 
access to the shared memory or the first memory, probability that the integrated circuit 
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100 can complete processes to be done in real time increases. 

[0077] Since latency time caused by access contention is avoidable, when image data is 
inputted, image data can be inputted smoothly, and when image data is outputted, image 
data is displayed on the display device smoothly without deterioration of quality of 
display. 

[0078] Having described preferred embodiments of the invention with reference to the 
accompanying drawings, it is to be understood that the invention is not limited to those 
precise embodiments, and that various changes and modifications may be effected 
therein by one skilled in the art without departing from the scope or spirit of the 
invention as defined in the appended claims. 
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